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Abstract 

A definition of metastable states applicable to arbitrary finite state Markov processes satisfying 
detailed balance is discussed. In particular, we identify a crucial condition that distinguishes 
genuine metastable states from other types of slowly decaying modes and which leads to properties 

Q 

similar to those postulated in the restricted ensemble approach 6] . The intuitive physical meaning 
of this condition is simply that the total equilibrium probability of finding the system in the 
metastable state is negligible. As a concrete application of our formalism we present preliminary 
results on a 2D kinetic Ising model. 
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I. INTRODUCTION 



In equilibrium statistical mechanics, it has been accepted for a long time that the canon- 
ical ensemble provides, at least for the vast majority of systems, an adequate description 
of their properties. It could be argued that this essentially reduces the problem of under- 
standing equilibrium properties to one of computation. On the other hand, for statistical 
mechanics far from equilibrium things are quite different: there are no laws corresponding 
to the Gibbs ensembles in order to calculate the probabilities of a given configuration in 
general, and the situation is still extremely complex. 

In this respect, metastable states occupy a curiously intermediate position: they are 
generally viewed as equilibrium states, i.e. as having a well-defined free energy, which is 
however distinct from that of the corresponding equilibrium state. Nevertheless, it is also 
clear that such states eventually decay through a process of nucleation which brings the 
metastable state to a true equilibrium state which is physically quite different. 

Traditionally, there have been many attempts to justify associating some equilibrium 
state to metastability through analytic continuation of the free energy. The oldest of these 
is, of course, the one due to van der Waals, which indeed works perfectly for mean-field 
theory. For models with short-range interactions, however, matters are more complicated: 
it has been shown [3( that the free energy has an essential singularity at the coexistence 
curve. Langer (^J provided a way to define an appropriate analytical continuation across the 
existing cut and gave a clear picture of the cause of the singular behaviour: it is, in fact, 
due to the presence of the droplets which eventually nucleate the equilibrium phase. 

In what follows we pursue a purely dynamical point of view of this problem. That is, 
we start from the main dynamical features of a metastable state and suggest a reasonable 
definition in terms of dynamic features alone. We then show that the metastable state thus 
defined can indeed be viewed as the restriction of the equilibrium ensemble onto a suitably 
defined subset. To achieve this goal, however, we must pay a (considerable) price: we must 
assume the system obeys very simplified dynamics, namely Markov chains satisfying detailed 
balance. Further, we shall concern ourselves strictly with finite systems and shall not take 
the thermodynamic limit. In part this is due to the fact that real difficulties arise when this 
limit is taken: since arbitrarily unlikely fluctuations will arise in arbitrarily short times in a 
sufficiently large system, it turns out that nucleation eventually becomes instantaneous in 
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the thermodynamic limit, which is clearly an artefact. A typical way around this problem 
might be to take a simultaneous limit to systems of infinite size as well as to parameters 
ever closer to the coexistence curve. We shall instead simply study the finite, though large, 
system. 

The phenomenon of metastability may be described informally as follows (see 0, [?| for 
a much fuller discussion along similar lines): a system is said to be in a metastable state if, 
upon starting the system in a certain subset of initial conditions, the system remains for a 
very long time in this limited subset of the set of all configurations, which is of negligible 
measure in equilibrium. Further, this subset is macroscopically distinct from the equilibrium 
state. Also, the return to equilibrium from a metastable state usually occurs in an abrupt 
fashion, i.e. the macroscopic variables do not change slowly from their metastable values 
to their equilibrium values, but rather, they remain essentially constant and then suddenly 
relax to their equilibrium value, by some quick relaxation mechanism. The requirement that 
the time during which the system remains in a metastable state be "large" means simply 
that it is sufficient to allow the system to relax to some kind of pseudo-equilibrium state. 
Thus, in a metastable state, the values of the macroscopic observables of interest will not 
show any systematic time-dependence, at least after some initial transient, the duration of 
which is much less than the decay time of the metastable state. 

The results presented in this work are derived for generic ergodic, acyclic Markov pro- 
cesses satisfying detailed balance with respect to the Gibbs measure. The typical system we 
have in mind is the finite kinetic 2D Ising model, which we discuss in section III. 

II. GENERAL FORMALISM 

Let us consider a Markov chain on a finite state space T with rates W a -^. a >, where a and 
a' denote states of T. The master equation for the probability of the system being found in 
state a is given by 



Since the Markov chain is assumed to be ergodic and acyclic |2j, well-known theorems assert 
that the solution approaches a unique equilibrium Po(<?)- If we further assume that detailed 



d t P(a) = LP; 




(1) 
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balance holds, that is, 

W^Poia') = W a ^P (a), (2) 

then it is also well known that the operator L defined in is self-adjoint with respect to 
the scalar product 

Since the underlying vector space is finite-dimensional, it then follows that there is a complete 
orthonormal set of eigenvectors P n satisfying 

LP n = -n n p n , (4) 

where the fl n are by definition arranged in increasing order. The existence of an equilib- 
rium distribution implies that Qq = and the corresponding P is in fact the equilibrium 
distribution. All other Q n are strictly positive. 
Using the orthonormality of the P n we can write 

£P„(<x) = 5 n , , (5) 

a 

implying that Pq(<j) is normalized and that adding to it arbitrary multiples of P n {a), for 
n > 1, does not alter this normalization. 

Oae thea ™ using standard tec h n lq nes Q at a tana! expression for the probaMi* 
of arriving from <jq to a in time t: 

P(a, t; a , 0) = P (a) + £ e -n»*. (6 ) 

„=i n(o-o) 

We now turn to the characterization of a metastable state within the general setting outlined 
above. In view of the informal description of metastability sketched in the introduction, it is 
clear that if we wish to have a behaviour different from equilibrium over a large time scale, 
one needs that at least one of the fl n be much closer to zero than the rest. 

Let us assume that Q\ ^ Q n for all n > 2. Now consider a process evolving from the 
initial condition a®. Then, following ©, in the relevant time range fl^ 1 ^ t ^ ^T 1 ) one 
finds that the configuration o is occupied with the following (time-independent) probability 

P{°) = Po{<t) + j}Hp 1 (*)- (7) 
Poi^o) 

Note that, due to (0), this is normalized. Since it differs exponentially little from the exact 
result, we may also conclude that it is everywhere positive, except perhaps in some places 



where it assumes exponentially small negative values; the latter can be fixed by setting the 
offending negative values to zero and recomputing the normalization. 

This result focuses our attention on the value Pi(o"o)/Po(cr ), which characterizes the 
nature of the initial condition. This quantity will be central to understanding the conditions 
under which the initial condition can truly be called metastable and the resulting probability 
distribution given by (J7J) can justifiably be identified with that of a metastable state. Let 
us be more specific. 

In what follows, we denote Pi(a)/Po(a) by C(a), and the maximum value of C(a) by C. 
Next we define the two sets T m and T eq as follows: 

r m := [a : | < C{a) < c] , (8) 

and T eq is defined to be the complement of T m . The choice of the factor 1/2 to define the 
lower bound on C(a) in (JHJ) is purely arbitrary and a matter of convention. 

We will show that given the previous scenario, the system will have a metastable state, 
in the sense discussed in the introduction, if 

E P °(°) « !» (9) 
o-er m 

i.e. that the probability of being found in T m in equilibrium is negligibly small, and we define 
the "metastable state" as the state described by the probability distribution 

P m (a)=P Q (<r)+CP 1 (a). (10) 

It should be stressed that, from a physical point of view, condition (JHJ) is the crucial as- 
sumption: it allows to distinguish true metastable states from other slowly decaying states. 
Of course, in concrete instances this hypothesis will not be easy to prove rigorously, and, 
for this reason, our approach is in a sense somewhat formal. We shall, however, show that 
a large number of consequences follow from Q. It is therefore sufficient to prove to 
show that the restricted state approach to the statistical description of metastable states is 
applicable. (Note that the importance of © was already pointed out in 0,Q|.) 

In what follows we will show that the properties of systems in which assumption © holds 
give rise to a behaviour which can be identified as metastabilty. These properties are: 

1. The probability that a state evolving from an initial condition do for which C(<7o) = C 
(or very close to it) leaves Y m in a time less than t is of order Qit. This justifies 
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identifying such a state as a very persistent one. From this result it also follows that 

E [PM + CP x {a)]^l. (11) 

From this inequality and the positivity properties discussed above, we conclude that 

P x {a) « -C^Poia), aeT eq . (12) 

Note, however, that the above feature is not enough to characterize a metastable state. 
A slowly decaying hydrodynamic mode, say, would have the same property. 

2. The probability that a state is found in Y eq after a time of order > evolving from 
an initial condition o"o such that C(ao) = (1 — p)C, is p. On the other hand, if the 
state has remained in T m for a time of order , then the value of C(a t ) grows to 
values very close to C on the same time scale. These results are crucial, because they 
mean that systems which have C(cr ) ^ C relax fast either to equilibrium or to the 
metastable state. Once they are in the metastable state, they can be described by the 
probability distribution P m (a) defined in (fTUj) . In order to prove this characteristic 
property, we have to make use of the defining property of metastable states Q. 

3. Finally, if we define a new process in which all transition rates connecting the 
metastable region Y m defined by (jSJ) to T eq are set equal to zero, we obtain another 
Markov process, also satisfying detailed balance with respect to the restriction of Po{cr) 
to r, m . We show that if both processes are started from the same initial condition o"o 
satisfying C(ctq) = C then the two processes remain close (in the sense of distance in 
variation) over a time of order This result leads to 

P x (a)*CP Q (a), aeT m (13) 

and 

21nC = ln £ Po^-ln £ ^oW, (14) 

which is interpreted in a natural way as the free energy difference between the two 
phases. 

Note that this final result also allows to carry over standard results valid for equilibrium 
systems to the metastable case: one first applies the result to the restricted process, 
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which is a bona fide Markov process defined on T m for all times, and then extends 
it to the metastable case by arguing that the two processes are close for the relevant 
timescale f^ 1 <C t <C f2j~ . In particular, the result derived in |l| can partly be 
rederived in this way: the fluctuation-dissipation theorem holds in metastable states 
of the kind we describe, because it can be derived as a general property of Markov 
processes with detailed balance. 

The above results therefore indicate that the program of defining a restricted equilibrium 
ensemble to describe metastability can be carried out in a fairly rigorous fashion in the 
context of Markovian proceses satisfying detailed balance. 

For a detailed derivation of these results, see J, 0|. Here we content ourselves with a 
rough sketch of how they come about. Note first the following basic property: 



where a(t) denotes a path of the Markov process defined by (0), and E denotes the expec- 
tation value. This relation is easily verified by a straightforward computation and means 
that e nit C(a(t)) is a martingale. 

To prove point (1), assume that the initial condition <7o satisfies C(ctq) = C. Now (fT5Jl 
means that, on average, C(a)e nit should neither go up nor down. Since it starts at the 
highest possible value of C(a), it has nowhere to go but down (on short time scales this is 
not significantly changed by the factor e Qlt ). Therefore going down a significant amount is 
unlikely. It is therefore not likely to leave T m in the relevant time scale. 

Point (2) is more technical: it can be shown that the condition Q implies that Pq and 
Po + CP\ are substantially different from zero on two disjoint sets. Therefore, if the initial 
condition a satisfies C(a ) = (1 — p)C, it evolves into a state given by 



But this state can be interpreted as being in the equilibrium state with probability p or in 
the metastable state with probability 1 — p. 

For point (3) consider the restricted process, where the rates are defined by 




(t < if) 



(15) 



P^(a) = P (a) + (l-p)CP 1 ((r) 

= pP ( a ) + (l-p) [P Q {a) + CP 1 {a)\. 



(16) 




otherwise. 




(17) 
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FIG. 1: Free energy F(M; (3, h) of the 2D Ising model (see (j22j) for the definition) for a 32 x 32 
sample with f3 := 1/T = 0.5, i.e. significantly below criticality. Note the secondary minima for 
7^ \h\ < 0.05, which are quite pronounced in spite of our considering a fairly large system. 

This process satisfies detailed balance with respect to P , just as does the original process. 
The trajectories of the physical process starting from o"o with C(o"o) = C have the same 
probabilities as the corresponding trajectories of the restricted process except when the for- 
mer cross from T m to T eq . But, as was shown in point (1), such crossings are unlikely, so 
the two processes indeed remain close to each other in the relevant time range. 

III. AN APPLICATION: THE ISING MODEL 

We now proceed to discuss how these ideas can be applied concretely to the case of the 
2D kinetic Ising model. As is well known, if T < T c and a small magnetic field h is applied, 
then the spontaneous magnetization in equilibrium points in the direction of the field. There 
is, however, for a broad range of parameters, a metastable state for which the magnetization 
is in the direction opposite to the field. 

We wish to show a way to obtain some confirmation of the ideas described above through 
simulations of this system. A crucial issue is to identify the observables which play an 
essential role in determining C(a) and hence T m . For the ferromagnetic Ising model, we 
assume that these observables reduce simply to the spin interaction energy E(o~) and the 
magnetization M(a). For systems of the size we consider presently, it is not possible for 
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a nucleating droplet, which is the crucial factor determining whether a system is or is not 
about to nucleate, to appear without noticeably affecting the values of E and M. We 
therefore assume that 

C(a)=$[E{a),M{a)), (18) 

which defines $(E,M). 

The equilibrium probability of a configuration a is 

P (a) oc exp [-/3E(<t) + /3hM(a)\ , (19) 

where (3 := 1/T. Summing over all configurations a having the same value of E and M, the 
equilibrium probability that the system is in the macrostate (E, M) is 

P (E, M) oc g(E, M) exp [—@(E - hM)] . (20) 

Here, g(E, M) is the density of states of the Ising model, given by 

g(E, M) = & \E ~ E (°)] ^ [M - M{a)\ . (21) 

(7 

This can be computed numerically in an efficient manner, say using the Wang-Landau 
algorithm P. floj| . 

In the metastable region T m one has P m = Pq + CP\ = (l + C 2 )Po, so that P m can also be 
expressed in terms of E and M using (|2()j) . Since the metastable state is well characterized 
by specific values of E and M, it is to be expected that the expression on the r.h.s. of (f2T)j) 
will show a local maximum at these non-equilibrium values. This is confirmed numerically 

n 

for P (E, M) as a function of E and M j5|. 
Here we plot in Figure ^ the free energy 

F{M; p, h) := -i In ^ g(E, M) exp[-^(E - hM)} (22) 

P E 

at a fixed subcritical temperature. A secondary minimum is seen in Figure ^ which cor- 
responds to the metastable maximum of Pq. Such a state of affairs will not exist in the 
thermodynamic limit: indeed, up to an additive term hM, F(M; (3, h) is the free energy 



of the Ising model in an ensemb 
theorems on short-range systems 



.e_ of fixed temperature and magnetization. By standard 
this must be equivalent in the thermodynamic limit to 



the free energy computed as the Legendre transform of the Gibbs potential calculated in the 
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grand canonical ensemble. Hence, as the thermodynamic limit is approached, F(M; [3, h) 
must tend to a convex function in M, and the additive term hM does not alter this fact. 
This is clearly at odds with the presence of two minima in F(M; (3, h) as shown in Figure 
[3 Therefore, our identification of E and M as adequate variables to determine C(a) is 
not tenable beyond a certain sample size. This is in agreement with the fact that for large 
systems a nucleating droplet may appear without affecting the values of E and M. 

In the systems in which E and M do furnish a complete description, it is possible to 
determine C and hence the free energy difference betwen the stable and metastable phase 
as follows: (fT4"j) yields C as a function of the probability of finding the system in T m in 
equilibrium. Since we have identified T m with a certain part of (E, M) space, we can readily 
compute this probability once g(E, M) is known. This free energy difference can also be 
compared with one obtained from hysteresis curves, and the comparison is quite satisfactory. 
These results will be discussed more extensively in |5| . Finally, extensions of this formalism 
to systems characterized by having several metastable states appear possible and are also 
presently under way. 
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